Technology & research

by | Wednesday, February 20, 2008

Patrick Dickson just forwarded an article in the APA Monitor titled Beyond chalk and talk, in which Art Graesser, the new editor of Journal of Educational Psychology, indicates an openness to including more technology related articles in JEP. Patrick argued that this means that JEP could be a good site for future publications by faculty and graduate students in educational technology. I am not so sure.

The article begins as follows:

Millions of children and adults play video games each day—in fact, video game design is the fastest growing U.S. industry. And while many video games are pure entertainment, others, such as the popular America’s Army, are teaching content to gamers of all ages, which makes incoming Journal of Educational Psychology (JEP) editor Art Graesser, PhD, wonder: Why isn’t education more plugged into gaming?

It goes on to argue that JEP would be more open to articles on technology and education.

The problem it seems to me is not that there isn’t research on the role of technology in education but rather that the field of educational psychology needs to rethink how it defines research in the field. Is it true that education is not plugged into gaming? I don’t think so. It is just that there haven’t been many articles in JEP about gaming. But that is not the fault of gamers and educational technologists. Not at all.

For the most part, a classic ed psy study takes a couple of years from conceptualization to implementation to analysis to manuscript – and then a year or so by the time it goes through reviews and revisions till final publication. Given the rapid rate of change in technology, this means that a publication is out of date by the time it reaches readers. By this time, the technology being studied is most probably out of date. In the fast changing world of educational technology, this is a problem.

Moreover, the demands of experimental rigor (often required for journals such as JEP) frequently mean that studies that make the cut are narrow in focus, or based on well funded research projects geared around developing specific software programs that have a tight and specific pedagogical role. This is all very good, but it seems to me that most of the action in the field of educational technology is happening not in large, funded projects bent upon developing new tools, but rather in generic, all purpose, maybe even free, software tools that can easily be used by teachers.

Think a moment about how many multi-million dollar federally funded projects have ever lasted beyond the expiry of the grant. (Do a search on NSF.gov website to see for yourself.) In contrast, the US Department of Education funded PT3 projects, with much looser guidelines about what constitutes research, have had a greater impact on teacher education programs and technology integration than any of these research-based grants. Now this is not to knock these research projects (clearly they play an important role in showing us what is possible) but rather to say that the matter of not enough educational technology research is a complex problem and not one that can be solved by more “classic” ed psy research.

Imagine conducting a rigorous study on the value of blogging on student writing. By the time you conduct the study, blogging itself may be less relevant technology. And more importantly, in conducting the research you would have lost opportunities to actually work with teachers and students and deepening your understanding of what benefits it may have. I have always used the example of Hypercard, a technology that was huge back in the early 90’s. Hundreds of studies were conducted and published about the educational uses of Hypercard. None of those studies mean anything much today. Such is the nature of technology.

However, if these studies had focused on broader issues of design and how one develops tools for learning, the situation would not be as bad. These “process” studies would still be informative – since issues of design (of what I have elsewhere called the act of going from “thought to thing”) are still important today. However, such a process study would not be published by JEP.

As an aside, I should add that it was this very reasoning that made me include a chapter on design in my dissertation back when I was developing a software program to teach about the periodic table of elements. My gut instincts were on the mark. A chapter that I published about the design process, still seems relevant today. The software I developed does not work any more since one of the plugins that it needed no longer exists today!

I would argue is what we need is not more journal articles but rather a new paradigm of research. A paradigm that is sensitive to the fact that we live in a new world, a world where things change fast and that research and its dissemination needs to reflect this.

To be blunt, JEP as a journal is not very relevant to educational technology researchers. I learn more about educational technology by following blogs and the websites than through any educational journal. Frankly, it seems to me that the main reason articles are published in many of these journals is to help academics get tenure. And over time this influence these journals have will wither away. That won’t happen anytime soon, but I know that there will come a day when some faculty member will receive tenure for maintaining an influential blog…

Of course, JEP and other journals of its ilk, could change. Clearly JEP has a superior brand name that it can leverage in this world of the Internet, but it will need moving away from a commercial publishing model to something else… exactly what it will be I am not sure of but there are some interesting opportunities here, if someone is willing to step up. However, I am not confident that this will happen anytime soon. I have blogged about a recent initiative here and here.

* Illustration constructed by Punya Mishra from images available here and here. Cartoon from here and Ed-Psy ambigram by Punya Mishra.

Topics related to this post: Learning | Psychology | Publications | Technology | Worth Reading

A few randomly selected blog posts…

Wordplay

Wordplay

Just some visual wordplay that I have indulged in, just for the heck of it. Nothing really special, though I am partial to the "Explore, Create, Share" design. That was the motto of the MAET program at MSU that I directed for years.  Innovate 2 on Creativity...

Sita sings the blues

I have been following Nina Paley's career for a while now. I first found out about her through the now defunct Desi website, badmash.com and have tracked her website off and on. Nina is an amazing animator and her best work is devoted to the Indian epic The Ramayana...

Thanks Wipro & Microsoft

#MSUrbanSTEM Thanks Wipro! #MSUrbanSTEM Thanks Microsoft Over this past summer I have had one of the best teaching/learning experiences of my career. Through a project funded by Wipro (and with support from Microsoft) we have the opportunity to work with 125 teachers...

Dirkin, Mishra & Altermatt (2005)

Dirkin, H. K., Mishra, P., & Altermatt, E. (2005). All or nothing: Levels of sociability of a pedagogical software agent and its impact on student perceptions and learning. Journal Educational Multimedia and Hypermedia. 14(2), 113-127. Abstract: This article...

Day 2 Morning session, Mishra & Light

I just completed my presentation Education Technology and Teacher Education, the TPACK framework. I think it went well, though you have to talk to ask the audience what they "really" think. I had been allocated 60 minutes for my talk - but Radha and I discussed...

TPACK & Creativity at Twente

I just finished a marathon session of presentations and discussions with the master's students in Curriculum Development and Educational Innovation at Twente University. It was wonderful to meet with them and discuss creativity, teaching, design, TPACK, among other...

Clement Mok on design

I was reading the final papers written by participants in my CEP 817, Learning Technology by Design seminar and came across this quote by Clement Mok in a paper written by Breanne Edmonds. I wanted to record it for future reference: Design means being good, not just...

Master’s course wins ATT Award

Just got the news from Carrie Albin, Outreach Coordinator of our Educational Technology Certificate Program (which is part of our Master's in Educational Technology program) that our CEP810 (Teaching for Understanding with Computers) course earned first place in the...

2 Comments

  1. azlio

    Your recent initiative on your post about “breaking free of academic publishers” is very great. I salute to you.

    Reply
  2. Dr. Matthew J. Koehler

    Good post, and for the most part I do agree. Although, I do think that being open to educational technology studies is a good thing, and a step in the right direction. I think skepticism is warranted.

    For example, an example of a study that would be ideally suited for JEP would be the one conducted by the National Center for Education Evaluation and Regional Assistance called Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort,” (Dynarski et al., 2007). In fact, this type of research is often disappointing, in that simply making good experimental design leaves out answering the important questions of what individual teachers do with technology, and considering the full interactions of how technology, content matter, and pedagogical approach interact. For a full critique of the study, please see our editorial.

    Another problem with the idea of doing “good experimental design” when it comes to technology research, was best illuminated by my own effort to get published in JEP when I was a graduate student. Armed with a nicely designed hypermedia environment, I tried to study its ability to perhaps impart better understanding to learners. I made the best control group possible, giving other learners videos, and documents about the same material. The Editor at the time called this type of research “disappointing” and a classic example of what was wrong with technology research in that it “compared apples to oranges.” *SIGH* Wasn’t that the point?

    Since then, I published it the Journal of Educational Multimedia and Hypermedia, and have found the Journal of Cognition and Instruction to be a good place to publish high-quality technology research.

    As far as the JEP goes, let’s hope times are changing. I for one will hope for the best but expect the worst.

    Reply

Trackbacks/Pingbacks

  1. Dr Matthew J. Koehler » Blog Archive » The Journal of Ed Psych … a good venue for Ed Tech? - [...] Punya Mishra has made a follow up blog entry, indicating his deep skepticism about JEP’s newfound interest in publishing…

Submit a Comment

Your email address will not be published. Required fields are marked *